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(57) Abstract: A system and mclhod of binding MPLS labels to virtually concatenated SONET/SDH Iransport connections is pro^ 
vidcd. A system and metkxl of binding MPLS labels to nxVT conncclions is provided and includes (1) classifying packets; and (2) 
mapping packcte with a same Torward equialence class to a same nxVT connection. TN a further emhodimcnl, ihc mapping includes: 
(a) associating a certain bandwidth of a connection between an external router and an add-drop multiplexer, between a source node 
and a destination node; and (b) creating an nxVT connection bciwcen the source node and tin: dcsUnation node, thereby creating a 
label switch path between the source node and the destination node. In anolhcr embodiment, a system and method of binding MPLS 
labels 10 nxVT connections is also provided and includes mapping packets with the same MIH^ label lo.lhc same nxVT connccUon. 
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SYSTEM AND METHOD OF BINDING MPLS LABELS TQ 
VIRTUALLY CONCATENATED SONET/SDH TRANSPORT 
CONNECTIONS 
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RELATED APPLICATIONS 
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claims priority to U.S. Provisional Ai>pUcationNo. 60/228,008, filed on 
August 23, 2000, and to U.S. Provisional Application No. 60/272,793, filed on 
March 1,2001. 

FIP.LD OF TH F. rNVENTION 
5 Hie present invention relates to optical networking. More particularly, 

tiie invention relates to a system and me&od of binding MPLS labels to 
virtuaUy concatenated SONET/SDH transport connections. 

BAC!KGROUN in THE INVENTION 
10 Bo& SOmr (See Synchronous Optical Network (SONET) Transport 

Systans: Conmion Generic Criteria. GR.-253-CORE, Issue 2, Revision 1. 

December, 1997,) and SDH (See International Telecommunication Union. 

Network Node Interfiaoe for ttie Synchionous Digital Hiaarchy. 

Recommendation G.707. Mardi, 1996.) «iable the use of virtual 
15 concatenation to siqjport both the (fynamic resizing of transport trunks and the 

grooming of traffic. More recently, advances in titie transport of routed 

datagram traffic leveraging flie research and e:qierience of ATM has resulted 

in the standardization of MPLS (See Internet Engineering Task Fwce. 

Multiprotocol Label Switching Ardiitecture. IETF Draft Document August, 
20 1999 and http://www.ietf.org/inteTOet-drafte/drafl:-ietf-iiq)ls-arch-06.txt). 

This work allows netwcdc devices to employ a standards-based method by 

which packet traffic can traverse a network, while receiving a previously 

agreed upon Quality of Service, 

Additionally, there is currently an effort underway by lETT (See 
25 Generalized MPLS - Signaling Functional Description; 

ftp://flp.ietf,org/inteDiet-drafts/drafl-ietf-mpls-generalized-signaling-05.txt), 

which atten:q>ts to adi^t the control plane semantics of generalized MPLS to 
allow vendor-independent provisioning of services at the tranqwrt layer. 
Traditionally, design approaches for large-scaled packet networks 
30 embrace fee use of multiple control planes. A typical example would be 
m^ing an IP overlay on top of a Layer-2 ATM network. Such networks 
typically suffer a discontinuity between the higher layer connectionless IP 
control plane running an ff routing protocol (whefear it be an intraior gateway 
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protocol, such as OSPF, or an exterior gateway protocol, such as BGP), and 
the lower layer connection-oriented ATM control plane running its own 
routing protocol CPNNI). Numerous approaches have bem submitted to 
standards bodies to address this issue, each with its various m^ts and 
5 dements. In addition to the discontinuity between the Layer 2 and Layer 3 
control plaxikes, the underlying transport layer connections, using such 
technologies as SONET, SDH, or DWDM, have typically been provisioned 
using a directed apinroach, where each cross-connect in the transport path is 
individual^ established using a vendor-specific element management system 
10 (EMS). As such, end-to-end provisioning of circuits has traditionally bem a 
laborious and time-consuming procedure for service provide. 

In a prior art system in Figure 1 , labels have been used to intercomect 
each forwarding engine so as to be distributed tfarougboat the MPLS domain. 

1 5 TrafGc associated with these labels would traverse the quasi-static label 
switched pa&s (LSPs) 140 and 142 used to interconnect devices wittiin the 
access networlc, so Utere are no issues related to label proliferation and usage 
of VT space on the SONET ring, hi Figure 1, prior art system 100 includes 
routers 120, 122, and 124, servers 130, 132, 134, and 136, an add/drop 

20 multiplexer QAUX) 1 12, logically interconnected as shown, in a ring 110. 
Servers 130 and 132 are logicaDy connected via LSP 140, while servers 134 
and 136 are logically connected via LSP 142. Router 120 is a MPLS router. 
There is a physical link 150. 

In this scenario, nodes in the access network receiving L3 packets firom 

25 attached routers would process the IP header or MPLS label and select an 
• outgoing label, used to direct the packet toward the appropriate line card at the 
destination node. This label is then pushed onto the label stack- Next, the 
label used to forward the packet to the destination node itself is selected and 
pushed onto the stack* 

30 At the destination node, the switch card, which is an MPLS LSR 

(Label Switched Router), will pop the top label off of the stack and examine 
the undorlymg label to detennine which Ime card the packet is to be switched 
to. In this way, an interoperable method of forwarding trafSc in the access 
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network is achieved. However, the cost is tiie ov«4iead of having the switch 
card pop the top label off of the label stack. The fimctionality necessary for 
this capability is essentially identical to that required for supporting access 
network topologies defined by sparsely connected . 

5 In other prior art systems^ any connections aflforded service guarantees 

were point-to-point (Transparent Lan Service received Best Effort service). 
As such, the admission control decisions were fairly sunple. However, in the 
cases described in tiiis document, anypoint-to-anypoint connectivity with 
service guarantees must now be supported. As a result, any port in the system 

10 can be significantly oversubscribed, due to multiple ports directing traffic to it. 
As such, when connections are established, a method of admission control is 
required to ensure that the level of oversubscription does not reach a point at 
which the associated service guarantees may be compromised. 

Thus, two levels of admission control are reqwred: the lowest level 

1 5 determines whether flie connection can be admitted, based on the existing port 
configuration and resources reserved for the currently established connections 
on those ports. This level of admission control can be implemented ux the CR- 
LDP/RSVP TrafBc Engineering module, local to each network element 
(residing on the present invention's switch card). Additionally, flus level of 

20 admission control should embrace a more sophisticated algoriftm than sunply 
accounting for the summation of CIR or FIR. 

The higher level of admission control is needed to detemune whether 
admitting (or deleting) the connection will cause the bandwidfli associated 
with the quasi-static node-interconnect LSPs to change. If so, the bandwidth 

25 of the relevant LSP is modified according to the two standards-based methods 
described above. This level of admission control is most easily placed in an 
element that has a global view of the topology (such as the centralized EMS, 
in the current software architecture). 

30 SUMMARY OF THE INVENTION 

The present invention provides a system and method of binding MPLS 
labels to virtually concatenated SONET/SDH transport connections. A 
system and method of binding MPLS labels to nxVT connections is provided 

4 
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and includes (1) classif/ing packets^ and (2) mapping packets with a same 
forward equivalence class to a same nxVT connection. In a further 
embodiment, the mapping includes (a) associating a certain bandwidth of a 
. connection between an external router and an add-drop multiplexer^ between a 
5 source node and a destination node, and (b) creating a nxVT conection 
between tlie source node and die destination node, thereby creating a label 
switch path between the source node and the destination node. 

In another embodiment^ a system and method of binding MPLS labels 
to nxVT connections is also provided and includes mapping packets with flie 
10 same MPLS label to the same nxVT connection. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates a prior art MPLS labeling system. 
Figure 2 illiistrates MPLS labeling in accordance with an exemplary 
embodiment of the present invention, 

15 

DETAILED D ESC3MPTION OF THE INVENTION 
Introdu^tjftn 

The invention described in co-pending and commonly assigned U.S. 
Patent Application No. (Number to be assigned) with Attomey Docket 

20 Number 55369-014 provides a system and method of virtually concatenating 
VT1.5S and STS-ls over SONET and SDH and WDM. The virtual 
concatenation invention allows users to setup connections or pipes with 
configurable bandwidth over either nxSTS-l/nxAU-3/nxAU-4 or 
nxVTl .5/mtTU-l l/nxTU-12 wiflun a nxSTS-l/nxAU-3/nxAU-4 pipe on an 

25 existing SONET/SDH network. This provides a connection or pipe of 

adjustable bandwidtii with a granuladty of close to 1 .5 Mbps to fit the needs of 
applications. The resulting connection can be treated as a TDM like 
connectioa 

By replacing "STS-1" with "AU-3" or "AU-4" and "VT or "VTL5" 

30 with'TU-H" or "TU-12", the virtual concatmation invention applies to 

nxAU-3/nxAU-4 and nxTU-1 l/nxTU-12 for SDH networks. For sinq)licity, 

these connections are called "nxVT" for botii SONET and SDH networks. By 
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replacing "STS-r with ''VT or "VT13", the virtual concatenation invention 
applies to nxSTS-1 and nxAU-3/nxAU-4. 

On top of the virtual concatenation invention, a dynamic bandwidtti 
allocation (DBA) protocol, which is described in co-pending and commonly 
5 assigned U.S. Patent Application No, (Number to be assigned) witb Attorney 
Docket Number 55369-015, allows for dynamically changing the throughput 
of all nxVT connections, based on the real-time trafSc loads of applications 
using the nxVT connections. The DBA protocol allows for the efficient use of 
the SONET/SDH bandwidth through statistical multiplexing. The same 
1 0 dynamic bandwidth allocation protocol ^plies to nxSTS-1 and nxAU- 
3/nxAU-4. 

The virtual concatenation invention provides for virtual concatenation, 
which includes creating a logical connection or pipe by combining mult^le, n 
(where n is a positive integer), STS-1 or VT connections or pipes, which may 
15 be contiguous or noiwjontiguous, mto a single connection or pipe, nxSTS-1 or 
nxVT» respectively, in order to si^jport a connection or pipe with a higher 
throughput than the througl?>ut of the origmalSTS-1 or VT pipes. 

By using virtual concatenation, the present invention uses dynamic 
bandwidth allocation protocol used to dynamically manage bandwidth on a 
20 ring (or gr^h of rings) topology. This technology allows for more efBcient 
capacity utilization on a ring (or multiple rings), by r^idly providing ring 
capacity to individual network elements on demand. As such, high capacity 
utilization is achieved for arfoitiafy trafSc loading patterns. 

The present invention provides a system and method of binding MPLS 
25 labels to virtually concatenated SONET/SDH transport connections. 

By leveraging the control plane semantics of MPLS, the present 
invention effects a more seamless management solution by allowing a device 
to participate as a peer in the topology exchange between attached routers at 
Layer-3 and core transport devices at Layer-2, Embracing this philosophy, the 
30 present invention employs MPLS label switched paths (LSP) to establish 
connections between devices in the transport network (See Internet 
Engineering Task Force. Extensions to RSVP for LSP Tunnels. IETF Draft 
Document September, 1999. http://www.i6tf org/intemet-drafts/draft-ietf- 
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ii9>ls-rsvp-lsp-timnel-04.txt) (See Mtemet EDgineeriiig Task Force. 
Constraint Based LSP Setiqp Using LDP. IETF Draft Document September, 
1999. http://wwietf.org/intemet-drafts/draft-ietf^ and 
provides a gateway functionality between attached IP or MPLS devices and 
5 the internal transport networic connections cairying traffic, whose available 
ring capacity is managed by the DBA protocol. Operating as an MPLS peer in 
the topology exchange at Layer-3 allows the present invention employs 
components of MPLS (See fotemet Engineering Task Force. LSP 
Modification UsmgCR-LDP. IETF Draft Document September, 1999, 
1 0 http://wwwiet£org/intemetHlrafts/draft4etf-nq)ls-^ .txt) to 

allow network op^tors to dynamically create/destroy transport level 
coimections and/or modify fheir associated Service Level Agreements (SLA). 
Label BiBdiny Issues 

When discussing label binding in the context of the pres^ invention, 
IS the present inventicms does the following: 

(1) the pre-establishmmt of label switched paths (LSPs) used to 
interconnect devices witiiin flie metropolitan access network, where these 
devices support the ability to dynamically modify the bandwidth associated 
wiA these LSPs; 

20 (2) the aggregation of connectionless IP flows or connection- 

orirated MPLS LSP traffic arrivmg at fbe edge device (firom attadied routers) 
onto paths that are routed through the access network on one or more of the 
above pre-established LSPs; 

(3) dynamic modification of bandwidth associated with both 
25 the pre-established LSPs and the Service Level Agreements (SLA) associated 

with the connections firom attached Layer-3 devices; and 

(4) bmding of labels used for LSPs that provide connectivity to 
core transport devices being used to interconnect various metro access 
networks. 

30 Referrring to Figure 2, by embracing the work underway in the IETF, 

edge devices in transport level access networks can exist as peers in the 
topology exchange of core transport devices via an interoperable, standards- 
based method. Therefore, the label bindings used to resolve the last bullet 

7 
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item in flie list above is considered beyond the scope of this document What 
is of particular relevance to the content of this document is the resolution of 
the issues described in the first two bullet items. For the purpose of this 
discussion, consider the network topology described by N network elements, L 
5 line cards per N, P interfaces ^physical or logical) per L, and F queueing 
subclasses (denoting an MPLS Forward Equivalence Class, or FEC) per P, 
LSPs Used to Interconnect NEs 

In the present invention, the worst-case number of LSP required to 
interconnect network elements on each ring is calculated according to the 

10 well-known formula ((( N * ( N- 1 )) / 2 )• Note that the gr^h can contam 
fewer vertices, in order to save VT space on the ring. However, m the case 
where a connected graph is not established, the network operator must 
establish an explicitly touted LSP tunnel to lonte traffic between endpoints of 
a connection that do not share an adjacency. Additionally, in the case \^ere 

15 the graph is not connected, packets traversing these LSP tunnels will endure 
increased delay and delay variance as a result of the increased hop count 
Perhq)s more hnportantly, this case requires that Ihe present mvention push 
and pop labels on the label stack, which will require CPU intervention. 
Because the present mvention's line and smtch cards provide QoS-capable 

20 forwarding of packet traffic, no dilation of the basic node interconnect graph is 
required Ititercoiuiecting networic elements to those of other v^ois may 
require the use of additional LSPs; one per FEC, for exanq)le. 
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These LSPs can be configured using either RSVP-LDP or CR-LDP. 
The essential behavior of these LSPs should be siixdlar in nature to those of 
ATM Soft-PVCs, For the general case, the bandwidth allocated for each LSP 
is calculated according to the following formula: 



LP LP 
BWLSP = max(( S E BWy )T^cEndpomtl, ( 2 Z BWy >Miu3poiDt2) 



10 For ttie case where only synunetric connections (where tixe specified 

bandwidth must be identical m each direction) are supported, the above 
expression is constrained such that each endpoint must have equivalent values. 
This constraint alleviates the necessity for any proprietary messaging to pass 
between the endpoints of an LSP, used to signal each end^oint^s 

IS corresponding component of the above e(?q)ressioa Thus, for tfie 

deconstructed case» where only symmetric virtually concatenated connections 
are sig>ported. Hie above expression reduces to: 

L p 

BWlsp = ( 2 E BWij ) 

20 

In the simple case, (he BW component of the summation above is 
simply the PIR associated with each connection on each line card of a network 
element The accuracy of the value BW could be improved by employing a 
25 slightly more sophisticated approach, such as the well-known equivalent 

bandwidth calculation [GuerinPl], which accounts for the effects of statistical 
multiplexing and aggregate utilization, as well as enq>loying a more realistic 
source model However, because DBA is managmg the bandwiddi usage 
within these LSPs, tibie amount of oversubscribing actually occuning is not of 
30 particular concern. 

Pvpamic Modincation ^S? R^ptf jfic^tipn 

It should be noted that, wh^ connections are added or removed firom 

the network, such that the bandwidth derived from the above expressions 

changes, the bandwidth associated with the LSP is dynamically adjusted. 

35 LSP Modification Using CR-LDP 

9 
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Modification of the bandwidth associated with an existing LSP begins 
with the issuance of a LDP Label Request Message by the node requiring 
more bandwidth. Within this message^ the encoded Type-Length-Value 
(TLV) will contain the newly requested bandwidth values, and the LSP 
5 identifier TLV (USPID TLV). On transmission of the Label Request Message, 
the sending node will retain the original entry in its FEC to Next Hop Label 
Forwarding Entry (FTN) table. 

On receipt of the Label Request Message, the receiving node will 
detect that the LSPID is identical to that of one of the entries in its Incoming 
10 Label Map (ILM)- If the receiving node did not find such an ratry in its ILM, 
it would simply treat the Label Request Message as a new label request, and 
process the request m the typical &shion. However, m this case, it wiU 
compute the new bandwidtti requked. The receivmg node will reserve only 
the difference between the original and new bandwidth values, in order to 
1 S prevent double booking the capacity. As such, this node will temporarily have 
two labels in its ILM with the same LSPID, 

Shnilarly, when the mitiating node receives the label from its LDP 
peer, two sets of labels will exist for the same LSPID. As such, flie initiatmg 
node will now have two outgomg labels for the same FEC. The mitiating 
20 node can then activate the new label m its FTN and begin flie process of 

releasing the old label, by sending an LDP Label Release Message to its peer. 

On receipt of the Label Release Message, the egress node will detect 
that the LSPID has another active label associated with it. As a result, this 
node will release the old label without deallocating the resources being used 
25 by that label 

Modification IMnif RSVP-LDP 
The method of LSP bandwidtii modification using RSVP-LDP is 
virtually identical to that used by CR-LDP, as this portion of CR-LDP is based 
on previous work in RSVP. However, the specific details of this functionaUty 
30 m RSVP are left for future study. 

Anvpoint-to-Anypoint Laver-3 Connectivitv 
This type of connectivity is provided through the use of Layer-3 
routing and forwardmg. As the L3 forwarding functionality resides on Ime 

10 
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cards in the present invention, each packet must contain infonnation that the 
switch card can use to detmnine the appropriate line card at the destination 
endpoint. 

The present invention appends a tag to the packet by fhc Layer--3 
5 forwarding engine to specify the line card. This is essentially a tag switching 
^proach* This method will work well on homogeneous rings employing only 
devices of the present mventioiu In this ^proach, the number of tags needed 
is calculated as the product of the total number of KBs (N - 1\ line cards (L), 
andFECs(F): 



10 



NUMtags = Fx((N-1)xL) 



For the current design, this inaplies (4 x(3lx8)) = 992 proprietary 
15 tags (10 bits). 

Dynamic Resizing of Virtually Concatenated Connectioq^ 
One of the essential benefits of the present invention functioning as an 
MPLS LSR lies in its ability to leverage CR-LDP or RSVP-LDP for 
dynamically resizing the dimension N of NxVT, NxTUl 1, or NxSTS-1 
20 connections. This capability provides a mechanism by which attached LSRs 
residing at the service provider's Point-of-Presence (POP) can signal the 
creation, destruction, or resizing of connections on an end-to-md (POP-to- 
POP) basis. This capability is afforded by tihie ability of Ihe present invention 
to function as an LDP peer with attached LSRs. 
25 Note tiiat, in the case wliere the attached router is not an LSR, the 

method available for dynamic resizing of virtually concatenated connections 
will levaage native RSVP over IP, rather than CR-LDP or RSVP-LDP. 



Conclusion 

30 The present invention relates to optical networking. More particularly, 

tii6 invention relates to a system and method of bindmg MPLS labels to 
virtually concat^ted SONET/SDH transport connections. 

Having fully described a preferred embodiment of the invention and 
various alternatives, tiiose skilled m tiie art will recognize, given tiie teachings 

n 
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herdn, that numerous alternatives and equivalents exist which do not depart 
fiom the invention. It is therefore intended that the invention not be limited by 
the foregoing description, but only by the appended claims. 
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QL^S 



We claim: 



A method of binding MPLS labels to nxVT connections 



comprising: 



5 



classifying packets; and 



moping packets with a same forward equivalence class to a 



same nxVT connection, 

2. The method of claim 1 wherein the classifying comprises 
10 identifying a packet by a packet field of the packet 

3. The method of claim 2 wh^rem the identifying comprises, if the 
packet is a Internet Protocol packet, examinmg the DHCP byte of flie packet* 

IS 4. The method ofclaim 2 wherein &6 identifying comprises^ if ttie 

packet is an PPP packet, examining FPP infoimation of the packet. 

S. The method of claim 2 wherein the identifying comprises, if Ae 
packet is an ATM packet, examming the VPI or VCI of the packet 



20 



6. The method of claim 2 wherdn the identifying comprises, if the 
packet is a Frame Relay padcet, examining the DLCI of the packet 



7. 



The method of claim 1 whmm the mapping conqnises: 
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associating a c^lain bandwid& of a connection betwera an 
external router and an add-drop multiplexer, hetweea a souzce node and a 
destination node; and 

creating a nxVT conection between the source node and the 
5 destination node* thereby creating a label switch path between the source node 
and the destination node* 

8. A m^od of binding MPLS labels to nxVT connections 
comprising mapping packets with the same MPLS label to fee same nxVT 
10 coimection. 



9. The method of claim 8 wherein tiie mapping comprises: 

associating a certain bandwidth of a connection between an 
external router and an add-drop multiplexer, between a source node and a 
15 destination node; and 

creating a nxVT conection between the source node and the 
destination node, thereby creating a label switch path between Ihe source node 
and the destination node. 



20 
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